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DESCRITPION 
Image creation device, image creation method, 
and image creation program 

Technical field 

The present invention relates to the creation of images such as yam images or the like. 
The created yam images can be used for creating simulated images of textile products such as 
knitted products, and the invention allows creating images portraying details like fluff, 
transparencies or the like in the case of textile products other than the yam, such as garments, 
and allows also obtaining images portraying transparency in the case of glass products or the 
like. 

Background art 

Simulation of knitted products requires images of the yarn making up the knitting 
stitches or the like. Herein, high-quality yam images are a must for achieving realistic 
simulations. For yam image inputting, the yam image is input by setting the yam in a scanner to 
capture thereby a yam image in which portions where color and ground color differ are equated 
to yam. The yam image thus captured is used, among other purposes, for simulating a knitted 
product (Patent Reference 1). 

The present inventors have observed that capturing a yam image using a white 
background yields a whitish yam image, whereas capturing a yam image using a black 
background yields a blackish yam image. A likely cause for this is mixing of the background 
image with the image of the yam in such translucent portions as yam fluff and the like, which 
results in whitish images for white backgrounds, and blackish images for black backgrounds. 

Mixing of the background image and the translucent portions of the object image, and 
the difficulties involved in separating the two, is a problem not only in yams but also in textile 
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products such as garments and/or glass products. In textile products such as garments, the 
background image and the textile product image become mixed in fluff portions, mesh holes, 
and portions where the fabric is very thin, the respective images becoming then difficult to 
separate. In transparent objects such as glass products or the like, the background image is 
visible through the glass, becoming difficult to separate from the image of the glass product 
proper. 

Patent Reference 1 WO 03/032203A1 

Summary of the invention 
Object of the invention 

An object of the present invention is allowing to easily create realistic images of objects 
having fluff and/or transparencies, with high quality. 

A secondary object of the invention is to remove the influence of background image 
unevenness and/or variability over various input operations, to allow creating more realistic 
image. 

A secondary object of the invention is to allow obtaining a realistic image that combines 
an image of an object with a new background image. 

Features of the Invention 

The image creation device of the present invention comprises: means for storing input 
images A, C of an object captured optically at least twice using different background images 
(Gl, G2); means for solving X and D in the system of equations 

A=G1+(X-G1)D 

C=G2+(X-G2)D 

wherein X is a color or monochrome image of the object and D is the opacity thereof; 
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and means for storing the obtained (X,D) as an image of the object. 

The image creation method of the present invention comprises the steps of: obtaining 
input images A, C by optically capturing the image of an object at least twice using different 
background images (Gl, G2); solving X and D in the system of equations 

A=G1+(X-G1)D (1) 

OG2+(X-G2)D (2) 

wherein X is a color or monochrome image of the object and D is the opacity thereof; 
and storing the obtained (X,D) as an image of the object. 

The image creation program of the present invention comprises: an instruction for 
storing input images A, C of an object captured optically at least twice using different 
background images (Gl, G2); an instruction for solving X and D in the system of equations 

A=G1+(X-G1)D (1) 

C=G2+(X-G2)D (2) 

wherein X is a color or monochrome image of the object and D is the opacity thereof; 
and an instruction for storing the obtained (X,D) as an image of the object. 

Preferably, the object is yarn, and the obtained (X,D) is stored as a yam image. 

Preferably also, the object is a textile product other than yarn, in particular apparel, and 
the obtained (X,D) is stored as a textile product image. 

Other than the foregoing, the object is preferably a translucent product such as a glass 
product, a transparent to translucent product such as film, thin paper or the like. 

There are preferably further provided means, steps and an instruction for changing the 
value of D so that, when the possible value of D ranges from 0 to 1, the value of D is set to D=0 
when equal to or smaller than a first predetermined value, to D=l when equal to or greater than 
a second predetermined value, and to 0 to 1 when the value of D is between the first 
predetermined value and the second predetermined value. 
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The system of equations of (1) and (2) may be solved exactly or approximately. Image 
input is easy when the background images are for instance a white background image and a 
black background image. Scanners, digital cameras or the like used for obtaining the input 
images of the object may be a part of the image creation device, or may be removed from the 
image creation device. 

Preferably, a composite image K is obtained through 

K=XD+F(1-D) 

by inputting a new background image F. 

Advantages of the invention 

As illustrated in Figs. 5, 6 or the like, the image creation device, image creation method 
and image creation program of the present invention allow creating high-quality and accurate 
images in a simple way. 

The image of the object itself and the image of the background do not mix with each 
other in the created images, even in high-transparency portions such as yarn fluff, mesh holes, 
glass products or the like, which prevents images from becoming whitish or blackish on 
account of the background. The following effects are achieved as a result. 

(1) Images can be portrayed with the hue and texture of the object being rendered 
realistically and with a three-dimensional effect. Details of the object such as fluff or the like, in 
particular, can be finely portrayed since they are prevented from becoming whitish or blackish. 

(2) No white streaks appear on contours even when an image created against a white 
background is combined with a black background. Similarly, no black streaks appear on 
contours even when an image created against a black background is combined with a white 
background. 

In the case of yarn images, simulation of knitted fabrics or the like using created images 
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yields a naturalistic representation of fluff or the like, and the hues thereof, which allows 
portraying knitted fabrics or the like with three-dimensional effect and in correct hues. 

Images can be created simply, for instance by inputting twice an image changing the 
background image. For creating the images, furthermore, it is not necessary herein to manually 
adjust an opacity image using a stencil or the like, as in conventional cases. 

Also, background image fluctuation, variability over various input operations, 
variability in the inputting means such as a scanner or the like, light scattered by the object itself, 
stray light leaking through gaps between cover and original plate glass, among other influences, 
can be avoided by setting opacity to 0 for portions in which opacity is equal to or smaller than a 
first predetermined value, to 1 for portions in which opacity is equal to or greater than a second 
predetermined value, and by expanding the dynamic range of opacity for values between these 
predetermined values. 

Brief description of the drawings 

Fig. 1 is a block diagram of a simulation device comprising a yarn image creation unit in 
an embodiment; 

Fig. 2 is a flowchart illustrating the input process of a yarn image in the embodiment; 
Fig. 3 is a flowchart illustrating an algorithm for creating a yarn image in the 
embodiment; 

Fig. 4 is a diagram illustrating opacity expansion processing in the embodiment; 

Fig. 5 illustrates a simulated image of a knitted fabric using a yarn image created in the 
embodiment, and a simulated image of a knitted fabric using a yarn image created in a 
comparative example; 

Fig. 6 illustrates another yarn image created in the embodiment, and a simulated image 
of a knitted fabric using that yarn image; 
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Fig. 7 illustrates another yarn image created in the comparative example, and a 
simulated image of a knitted fabric using that yam image; 

Fig. 8 illustrates an image of a garment created in a second embodiment, combined with 
two backgrounds, a white one and a black one; 

Fig. 9 illustrates an image of a garment created in a conventional embodiment, 
combined with two backgrounds, a white one and a black one; 

Fig. 10 illustrates a white background image used for creating the image of Fig. 8; 

Fig. 1 1 illustrates a black background image used for creating the image of Fig. 8; 

Fig. 12 illustrates an image of a whole-body garment created in the second embodiment, 
combined with two backgrounds, a white one and a black one; 

Fig. 13 illustrates a white background image used for creating the image of Fig. 12; 

Fig. 14 illustrates a black background image used for creating the image of Fig. 12; 

Fig. 15 illustrates an image of two glasses created in a third embodiment, combined 
with a background image; 

Fig. 1 6 illustrates an image of two glasses created in the third embodiment, combined 
with two backgrounds, a white one and a black one; 

Fig. 17 illustrates a white background image used for creating the images of Fig. 15 and 
Fig. 16; and 

Fig. 18 illustrates a black background image used for creating the image of Fig. 15 and 

Fig. 16. 



Description of the reference numerals 

2 Simulation device 4 Color scanner 

6 Keyboard 7 Stylus 

8 Color monitor 10 Color printer 
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Display of a yarn image against a black background 




Display of a yarn image against a white background 
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Simulation image of a knitted fabric using a yarn image created in an embodiment 




Yam image created using a white background in a comparative example 
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Display of a yarn image against a black background 
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Display of a yarn image against a white background 
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Simulated image of a knitted fabric using a yarn image created in a comparative 



example 

61 Display against a black background of a yarn image created in an embodiment 

62 Display against a white background of a yarn image created in an embodiment 

63 Simulated image of a knitted fabric using a yam image created in an embodiment 

71 Display against a black background of a yarn image created using a white background 
in a comparative example 

72 Display against a white background of a yarn image created using a white background 
in a comparative example 
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73 Simulated image of a knitted fabric using a yarn image created in a comparative 
example 

Embodiments 

Preferred embodiments for carrying out the invention are explained next. 

Fig. 1 to Fig. 6 illustrate a first embodiment of the creation of a yarn image, and Fig. 7 
illustrates a yam image obtained in a comparative example, for reference. Fig. 1 illustrates a 
simulation device 2 using an image creation device of the embodiment, wherein 4 may be a 
color scanner, a digital camera or a monochrome scanner for image input. The reference 
numeral 6 denotes a keyboard and 7 denotes a stylus, which can be replaced by suitable input 
means such as a mouse, a trackball or the like. The reference numeral 8 denotes a color monitor 
on which are displayed the obtained yarn images, the created knit design data or simulated 
images of knitted fabrics, or garments from the design data. Similarly, the yarn images, knit 
design data, simulated images and the like are output via a color printer 10. 

The simulation device 2, which is connected to a LAN via a LAN interface 12, inputs 
and outputs yarn images, knit design data or simulated images or the like, and similarly, inputs 
and outputs yarn images, knit design data or simulated images via a disk drive 14. Instead of 
being obtained by means of a color scanner 4, yarn input images may be captured by a remote 
scanner and be input through the LAN interface 12, the disk drive 14 or the like. 

The reference numeral 15 denotes an image creation program read by the simulation 
device 2 through the disk drive 14, the LAN interface 12 or the like, for creating yarn images or 
the like. The image creation program 15 comprises a storage instruction 16 for storing yarn 
input images for two different background images such as black and white; a storage instruction 
1 7 for storing yam color data X and opacity D; and an expansion instruction 1 8 for expanding 
the opacity D; as well as a storage instruction 19 for storing the created images (X,D) of the 
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yarn or the like. The image creation program 15 is explained in detail below with reference to 
the flowchart of Fig. 3 . The background image may be referred to simply as background, and 
the yarn color image may be referred to as color data. 

The image creating unit 20 for yarn or the like is provided as a part of the simulation 
device 2, but the image creating unit 20 may also be provided as an independent image creation 
device in combination with the color scanner 4 or the like. The reference numeral 21 denotes a 
white background image storing unit for storing input images of yarns against a white 
background, for instance by closing the cover of the color scanner 4. The black background 
image storing unit 22 stores input images of yarns against a black background, for instance by 
opening the cover of the color scanner 4. Two images are stored herein, against a white and a 
black background, but the images may also be stored against any two different backgrounds. 

The color data calculating unit 24 calculates the color value X of the yarn images, and 
the opacity calculating unit 26 calculates the opacity D of the yarn images. The expansion unit 
27, for instance for an opacity D ranging from 0 to 1 , converts to 0 a value of D equal to or lower 
than a first predetermined value, converts to 1 a value of D equal to or higher than a second 
predetermined value, and converts to 0 to 1 a value of D between a first predetermined value 
and a second predetermined value, thereby expanding the dynamic range of D. The expansion 
unit 27 may optionally be omitted. The image storing unit 28 reads the color data X and opacity 
D (expanded) thus created and stores them retrievably. 

In the present embodiment the color data X are handled employing a RGB system, but 
may also be handled using an HVC system, Lab system or the like; also since the opacity D is 
determined for each RGB component, the average value thereof for instance is treated as the 
opacity D. In HVC the value V represents color lightness, and hence the opacity D may also be 
calculated using the value V if HVC is employed. 

In the knit design unit 30, knit products are designed using the color scanner 4, keyboard 
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6, stylus 7 or the like, then the designed data are converted into knitting data for a flat knitting 
machine. The simulation unit 32 converts into simulated images the design data of a knitted 
fabric or garment determined by the knit design unit 30, and portrays the texture and 
three-dimensional effect of the garment by distinctly representing the yarn image. The knit 
design unit 30 and the simulation unit 32 are known in the art, for instance as disclosed in Patent 
reference 1. 

Fig. 2 illustrates yarn image inputting using a color scanner. The yarn is set on the 
original glass plate or the like of the scanner and is pressed with the cover, without wholly 
closing the latter to avoid crushing the fluff. The cover is then opened and the yarn is scanned to 
obtain a black background image. Similarly, the cover is closed and the yarn is scanned to 
obtain a white background image. Since the two input images, black background and white 
background, are used later on superposed onto each other, the yarn should not move during the 
time intervening between two image inputs. An image capture range should preferably be 
specified for the scanner, since the periphery of the fluff is the only other required image. 

Fig. 3 illustrates an algorithm for creating images of yarns or the like. An input image A 
with a black background is read from a black background image storing unit, and an input 
image C with a white background is read from a white background image storing unit. B is the 
value of the black image of the background and W is the value of the white image of the 
background. As explained above, A, B, C and W are RGB images and exhibit therefore a 
256-gradation of 0 to 255 shades. Further D is the opacity, and D is for a monochrome image 
and has 256 halftones. 

The relationship between the black background image A, the value B of the black 
background image, and the color image X and opacity D of the yarn, is given by A=B+(X-B)D. 
Similarly, the relationship between the white background image C, the value W of the white 
background image, the color image X and opacity D of the yarn, is given by C=W+(X-W)D. 
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X and D can be determined from these two equations. For instance, 
D=(A-B)/(X-B)=(C-W)/(X-W) (3) 

allows expressing D based on X. Alternatively, by determining the difference between 
A and C we obtain 

A-C=(B-W)-(B-W)D (4) 

from which D can be solved as 

D={(A+W)-(B+C)}/(W-B) (5) 
X can be determined from 

X={W(A-B)-B(C-W)}/{(A-B)-(C-W)} (6) 

The method used for solving the system of first-degree equations to determine D and X 
may be any arbitrary method; herein, an exact numerical solution of the equations is not 
mandatory, an approximate solution thereof being also acceptable. 

The input image is processed next, for instance sequentially pixel by pixel, to determine 
the values of X and D. One pixel is acquired, the X value and D value thereof are determined as 
described above, and the process is repeated until completion for all pixels. The color data X 
above are RGB data, and therefore the opacity D has also a value DR obtained using an R image, 
a value DG obtained using a G image, and a value DB using a B image; herein, however, 
though the color data X has 3 components XR, XG and XB, the opacity D is taken as the 
average of the DR, DG and DB. For averaging can be used an arithmetic mean, a geometric 
mean or a median, instead of a mean. 

When the value of D is substantially 0, i.e. when the value of A+W and the value of 
B+C are substantially identical, it may be assumed that what appears is the background image 
and that there is no yarn for the pixel in question. When the value of D is substantially 0, 
therefore, both D and X are set to 0. When the value of D is not substantially 0, the value of D 
ranges from 0 to 1 ; for instance when D is equal to or less than 40/255, both D and X are set to 
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0. When D is equal to or higher than 210/255, D is set to 1 and the value of X remains 
unchanged. When the value of D is 40/255 to 210/255, D is expanded to range from 0 to 1 . All 
the pixels of the input image are processed in this way to store a yarn image (X,D). 

In the processing for determining the color data X and/or the opacity D from the input 
image A, C, the denominator of the color data X is determined first for instance through 
equation (6), so that when that value is substantially 0, the opacity D and/or the color data X 
may be equated to 0, and D and X may be determined for regions where D is not 0. 
Alternatively, the opacity D may be determined first using equation (5), after which the color 
data X is determined using equation (6). Whether to determine D and X for each pixel, or to 
determine first the opacity D for the whole image followed by determination of X, is a matter of 
arbitrary design. 

Fig. 4 illustrates expansion of the opacity D; herein, the value of D is set to 0 when equal 
to or lower than a first predetermined value, for instance 40/255. The value of D is set to 1 when 
equal to or higher than a second predetermined value, for instance 210/255. The dynamic range 
of D is expanded so that the remaining values of D, 40/255 to 210/255, may range from 0 to 1 . 
Fig. 4 shows the value D' after expansion. 

A value of D equal to or lower than 40/255 corresponds to high transparency, which is 
likelier to be the result of background image unevenness, image inputting variability over 
various input operations, influence of light scattered by yarn on the scanner or the like, than the 
result of there being no yam for the pixel in question. Therefore, the value of D is set to 0 when 
equal to or lower than 40/255. A value of D equal to 210/255 or higher is presumably the result 
of image input disturbances, such as image input variability, or of the scanner cover being 
closed leaving a small gap between cover and glass plate upon attempting to prevent yarn 
compression. Similarly, thus, the value of D is set to 1 when equal to or higher than 210/255. 

For comparison purposes, a yarn image is created using a white background image only. 
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For creating the yarn image of the comparative example, the background image is equated to a 
white single color, an opacity D mask is provided, such that the portions where the values of the 
input image change from the values of the background are taken as yarn images, and the color 
image X of the yam is cut out. When the opacity D approaches 0, the values of the color data X 
approach the background image, while when the opacity D approaches 1 , the difference 
between the color data X and the background image increases. In this algorithm a realistic yarn 
image could not be obtained, and hence a stencil was used to manually retouch the opacity 
image with a view of obtaining a yam image as realistic as possible. 

Fig. 5 illustrates a created yam image. The reference numeral 51 in the right denotes a 
yarn image created in the embodiment, 52 denotes this yam image displayed against a black 
background, and 53 is the same displayed against a white background. The reference numeral 
54 denotes a simulated image of a knitted fabric using the yarn image created in the 
embodiment. In the left half of Fig. 5 is displayed a yam image 55 of a comparative example, 
which was created as described above using a white background. The reference numeral 56 is 
the yam image of the comparative example combined with and displayed against a black 
background, whereas 57 is the yam image of the comparative example displayed against a 
white background. The reference numeral 58 denotes a simulated image of a knitted fabric 
using the yam image of the comparative example. The yam image 51 and yam image 55 were 
input on the same position and using the same yam. 

A comparison of the yam image 5 1 and the yam image 55 shows that more fluff is 
displayed in the yam image of the embodiment, while the yam image of the Comparative 
example is a more whitish image. Visual examination of the portions where the background 
was black reveals white-streaked portions, visible on the sides of the yam of the Comparative 
example, and caused by white background being taken as the yam image through mixing of the 
white background color with the color data of the fluff of the yam. By contrast, the yam image 
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51 of the embodiment is a realistic, true-to-life image rich in fluff, whether observed against a 
black background or a white background. A comparison between the simulated images 54 and 
58 reveals that the image 54 using the yarn image of the embodiment has plenty of fluff and 
portrays the three-dimensional effect of the knitted fabric. In the image 58 of the Comparative 
example, by contrast, the knitted fabric appears lifeless and elicits a thin, flat feeling. 

Fig. 6 illustrates a yarn image created according to the embodiment, using another yarn, 
61 being the yarn image displayed against a black background and 62 being the yarn image 
displayed against a white background, and illustrates a simulated image 63 using the yarn 
image. For reference, Fig. 7 illustrates a yarn image created according to the Comparative 
example, using a white background, and a simulated image 73 using this yarn image. The 
reference numeral 71 denotes the yam image created according to the comparative example 
(created with a white background) displayed against a black background, and the reference 
numeral 72 denotes the same displayed against a white background. The yarn image in the 
comparative example appears whitish overall, and portrays fluff thicker than it actually is. 
Upon comparison of the simulated image 63 with the simulated image 73, a fine fluff coupled 
with a three-dimensional effect is portrayed in the embodiment, whereas the simulated image 
73 of the comparative example portrays a fluff thicker than it actually is, with a rendering 
lacking in three-dimensional effect. 

The embodiment affords the following effects. 

(1) A yarn image can be easily created by capturing twice a yarn image at the same 
position, using two backgrounds, a white background and a black background. 

(2) In the created yarn image, the color data and opacity of the yarn are rendered 
realistically, the yarn main body and fluff being portrayed with high quality. 

(3) The hue of fluff portions and/or the whole image can be realistically portrayed upon 
creation of simulated images of knitted fabrics or the like using the obtained yarn image, which 
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allows accurately portraying the texture of the knitted fabric. 
Embodiment 2 

In the above embodiment was described the creation of a yarn image, but the present 
invention can be used as well for creating images of textile products such as garments, or of 
transparent objects such as glass products or the like. The problem in the case of yam images 
was to differentiate and separate fluff and background. Since fluff portions are translucent, an 
additional problem was to avoid mixing of the background with the excised fluff image. In 
other textile products as well it is important to automatically cut out portions that are difficult to 
excise from the background, such as fluff or the like, and to remove the background image from 
the image of the object in translucent portions. Textile products include, besides apparel, 
curtains, blankets, table covers, cushions or the like. In addition to textile products, moreover, 
the present invention can also be used for creating images having transparencies such as images 
of glass products, films, thin paper or the like. The present invention allows obtaining the 
opacity D and an image X of the object itself separated from the background. The composite 
image K is given by 

K=XD+F(1 -D)=F+(X-F)D (7) 

wherein X is the image of the object, F is the background image to be combined with the 
object, and D is the opacity of the object image. Two kinds of background are preferably used, 
more preferably solid backgrounds. Background portions are preferably input for instance 
manually in order to input which portions in the captured image are background and which 
portions correspond to the object. 

Capturing images with changing backgrounds using a scanner is difficult in 
garment-wearing mannequins, furniture, household implements, glass products or the like; thus, 
such images are photographed with a digital camera in which the background is changed to 
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white and black. Compared with using a scanner, interior photography using a digital camera, 
which cannot match the excellent photographic environment of a studio or the like, is prone to 
suffer from background unevenness, and hence it is preferable, during the opacity extension 
processing, to expand the range of D=0 and/or D=l somewhat wider than is the case in Fig. 4. 

Figs. 8 to 1 1 illustrate an embodiment relating to images of mesh-type knitwear worn by 
a mannequin. Fig. 10 and 1 1 are images taken with a digital camera, against a white or black 
background. Fig. 9 is a composite image with a white or black background, through manual 
creation of a stencil from Fig. 1 1 and cutting out of the garment image. In the conventional 
embodiment of Fig. 9 fluff appears unnaturally black against the white background. This stems 
from the difficulty of cutting out only the pixels corresponding to the fluff, and from opacity 
ambiguity, which causes the black background image to become mixed with the pixels of the 
cut out fluff. By contrast, the embodiment in Fig. 8 affords an image with fluff rendered 
naturally, both against a white and a black background. 

The image creation device and/or image creation program of Fig. 1 can be used as is for 
images other than yarn, for which the algorithm of Fig. 3 can also be used without modification 
as an image creation algorithm. As explained above, images can be captured using digital 
cameras or the like, instead of by image scanning as in Fig. 2. The description relating to the 
embodiment of Fig. 1 to Fig. 7 applies to Embodiment 2 and Embodiment 3. 

Figs. 12 to 14 are images of a mannequin wearing the same garment. Fig. 1 3 and Fig. 14 
correspond to images captured with a digital camera against a white or black background; Fig. 
12 is an image created based on the embodiments, and synthesized against a white or black 
background using respectively the images of Fig. 13 and Fig. 14. Fig. 12 portrays the mesh of 
the sleeves and pants, which have transparencies. In the unmodified images of Fig. 13 and 14, 
by contrast, it is difficult to separate the portions having mesh holes from the image of the 
garment itself and from the images of the background. Changing the background results thus in 
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an unnatural image. 
Embodiment 3 

Figs. 15 to 18 illustrate a third embodiment relating to images of a glass product. 
Fig. 17 and Fig. 18 illustrate images of a glass and a jug taken with a digital camera, against a 
white and a black background. Fig. 1 5 illustrates a composite image resulting from combining a 
glass-product image X and an opacity D image thereof, obtained from the above glass and jug 
by application of the embodiment, with a background image of a table and an ashtray, and with 
a white and black background image, in Fig. 16. Since an opacity D image is obtained, the 
resulting image looks natural even when backgrounds change (Fig. i6), and even against 
non-uniform backgrounds such as the background of Fig. 15, which contains an ashtray; 
surface gloss, moreover, is portrayed in line with transparency (Fig. 15, Fig. 16). 



17 



